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CHAPTER 1 


INTRODUCTION 

'Programs are not textj they are hierarchical compo- 
sitions of computational structures and should be constructed, 
edited, compiled/executed and debugged in an environment that 
consistently acknowledges and reinforces this view point' 

[TEI 81]. 

Current programming systems are woefully inadequate in 
this respect. For example, programs are written using a text 
editor, which defines a programming environment in terms of 
lines and characters. Such an editor does not know that the 
character sequence b,e,g,i,n has a specific meaning, A 
compiler however defines another environment in which begin 
is recognized as a significant keyword. From a programmer's 
viewpoint, it is confusing to have two vastly different 
environments for typing in a program and compiling/executing 
it. He has to constantly translate back and forth between 
the structured object he understands and the sequential form 
the programming system allov\/s him. 

It is therefore desirable to have a programming system 
which not only preserves the structural form of a program 
while inputting and storing but also interacts with the 
programmers at the structural level. 
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V\?e have implemented such a programming system, based on 
a source program file organization in which structure is 
manifest. Recently, Teitelbaura [TEI 81 ] has announced a 
syntax oriented programming system, Vvhich is also based on 
program structure. Vi/hereas his is an integrated system, 
incorporating the functions of an editor, compiler, inter- 
preter and a debugger, ours consists of a program constructor, 
an incremental compiler and a pretty printing program, all 
working on a common interface, v/hich is a structured represen- 
tation of source programs called SSPF (for structured source 
program files). 

The program constructor provides an editing environment, 
which makes use of the programming language syntax. It is an 
editor in the sense that it is used for creating or modifying 
a program. However, its instructions do not operate on lines 
and characters but on program constructs. Instead of typing 
the character sequence for the word ' begin * , the program 
constructor provides an instruction, which has the effect 
of putting the keyword pair begin ... end at the current 
position of the program text, provided it is syntactically 
correct. 

The chief purpose of the program constructor is to 
build the structured representation. This structure consists 
of all the information necessary for generating intermediate 
code. Problems like non-matching and misspelled key-words 
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cannot occur. 

A major advantage of such a programming environment is 
that a user cannot write structurally incorrect programs. The 
SSPF organization allows for a more efficient program trans- 
lation in that the need for recognition of character sequences 
as lexical units and lexical units as syntactic units is 
minimized. It also allows incremental compilation, reducing 
the burden of scanning the entire source text of program, 
in case of any modifications of the program. Such a feature 
is very economical during program development stage. 

The pretty printing program maps the structured object 
( program) into a sequential text, with proper indentation 
reflecting its structure. 

In this thesis, we have described the implementation of 
a programming system based on SSPF for the programming 
language Pascal-S. A syntax oriented editor for Pascal-S 
described in [PAR 81] and an incremental compiler for the 
same programming language discussed in [JAJ 80] form the 
basis for our work. 

Chapter 2 of this thesis is on structured source 
program files and also describes how they can be used as a 
basis for designing a new programming system. 

Chapter 3 discusses the format of SSPF for Pascal-S 
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programs as used in the implementation of the components of 
our programming system. 

Chapter 4 discusses the program constructor and 
Chapter 5 describes the incremental compiler. 

Chapter 6 is a user manual for the programming system, 

ViJe conclude our thesis in Chapter 7. The program 
listings of various components of the programming system 
have been given as a supplement to this thesis. 



CHAPTER 2 


STRUCTURED SOURCE PROGRAI^l FILES 

The need for storing programs with their structure 
preserved has already been stressed. Since a programming 
system has to identify various computational units in the 
program to allow modification at that level, storing programs 
as a text is very inefficient and unnatural. 

In this chapter we describe how we can store programs 
with their structure intact, and how such representation 
can be utilized in a programming system that has the proper- 
ties, we seek (Chapter l) . Their organization is based on 
flow-trees suggested in [JAJ 78], 

2 . 1 FLOW TREES 

Those constructs which produce a program with nested 
structure are preferred by many present-day programmers. 

Such a structure expresses hierarchical relationship among 
program segments. Flow trees provide a natural way for 
preserving and displaying this hierarchical relationship. 

They are useful in understanding the flow of control in 
terms of the hierarchy implied by the use of various 
structured constructs. 

As the name suggest, flow trees are tree like represen- 
tations of programs. Each unit in the program is represented 
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as a part of the flow tree. Each structured construct has a 
certain number of components. Such a construct is represented 
by a node called control-node. Its components are represented 
by the sons of this node. In each control-node, we can store 
the type of the control-construct. For example, the control 
construct ’ while B ^ S' has the structure shown in Fig. 2.1. 

In the same figure, flow tree representations for other 
program constructs are also given. 

A complete program can be represented in flow tree form, 
using these basic structures. In flow trees, the leaf 
(terminal) nodes alv/ays contain source program text. It is 
through the interior (non-terminal) nodes that the structure of 
the source programs is reflected. 

The meaning of any control-node can be derived by identify- 
ing the components and knowing the relationship, it imposes on 
these. This relationship is characterized by the possible 
execution sequence of the components, which the control node 
induces. A control node, thus implicitly contains all the 
information to execute the subtree rooted by it. Consequently, 
execution control flow can be understood through the traversal 
of the flow- tree, 

2.2 SSPF ORGANIZATION 

We have already emphasized that the programmers interaction 
with the programming systems should be at a structural level and 
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not at sequential level. Preserving structure in source 
programs helps in designing a programming systems that allows 
such interaction. Flow trees provide a framework in which 
we can design SSPF. 

Programs are stored in a tree like fashion with nodes at 
various levels. At each of these nodes, we can store a great 
variety of information depending on the type, pointers to sons 
and possibly also to the parent. 

Control-flow information is automatically reflected 
through the flow- tree representation. 

To cater to declaration of identifiers, we can associate 
the declarations v\/ith the root of the subtree over which they 
are to have effect. I7e have modified this somevjhat, to as to 
be able to identify various types of declarations (constant, 
type, variable, procedure and function). These declarations 
are attached as sons of either prog or proc or func nodes. 

With a separate node type as a root for each declaration 
section (see Fig. 2.2). 

The exact set of node types used in the SSPF depends 
on the language used, 

2.3 CREATION AND MODIFICATION OF SSPF 

When creating the program, the program constructor 
prompts the user according to the syntax of the programming 
language and simultaneously maps the source received into 
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SSPF form. For example, the current node is declared as a 
wd node. Then the program constructor can respond by 
creating its tv^/o sons and prompting the user to supply a 
boolean expression- for the first son and a statement for 
the second. 

When modifying the program, the program constructor 
instead of allowing the user to view the program as a sequence 
of lines, allows him naturally to view it as a composite of 
several structured units. It can have commands like j 

1, Move to the else clause of the current statement. 

2, Move to the next case in the case statement being 
scanned. 

3, Skip over the entire block, that is currently being 
edited, 

4, Move to the program segment named ’FIND*. 

5, Substitute one variable name for another in the specified 
block, 

6, Change the specified repeat ... Until construct into a 
while - ^ construct. 

7, Delete the specified program segment. 

2.4 COMPILATION OF SSPF 

The SSPF organization outlined above, provides an 
opportunity for incremental compilation, (If a program is 
modified, only the modified part need be recompiled). The 
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compilation proceeds by traversing the SSPF in a fixed order 
(pre-order) and compiling each node encountered. Compiling 
each node in the SSPF produces compilation - information which 
is either used to augment the object code produced thus for 
or to update the global compiler tables or to do both. This 
c ompilation- information is stored in the nodes of the SSPF, 
as far as possible for use in subsequent compilations to 
achieve incrementality . 



CHAPTER 3 


SSPF FORMAT FOR PASCAL-S 

We have outlined in Chapter 2, how structure preserving 
source program files can be used in designing/implementing 
a new programming environment. 

In this chapter, we delineate the format of such files 
for Pascal-S and how they can be stored in computer such 
that they can be created and manipulated by the programming 
system. 

One major decision has been where exactly to stop 
preserving the structure of source programs in a flow-tree 
form. For example, the node representing an assignment 
can have two sonsj a variable part and an expression part. 
The expression part can be further broken into factors, 
terms, identifiers and so on giving rise to a complex 
flow tree segment. We have decided to stop structuring 
at statement and declaration level, 

3.1 IDENTIFICATION OF NODES IN A FLOW TREE 

The program constructor in editing node, allows program 
modification. The programmer therefore has to be able to 
identify various program segments and be able to refer to 
them. 

In Come 11-program synthesizer [TEI 8l] this is 
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accomplished through cursor positioning,. The cursor can 
be moved backwards and forwards in steps through the 
program and can be used to point at a whole program units 
Template (a predefined, formatted pattern of characters 
and punctuation marks. The key-words, punctuation and 
indentation format of a template can't be altered), phrase 
(an arbitrary sequence of typed symbols) and place holder 
(identify locations where insertions are permitted). Editing 
commands allow operations on these entities,. Implementing 
such a scheme requires the availability of intelligent and 
high speed video terminals. 

We have chosen a scheme, in which each node in the 
program flow tree has a unique number, which can be used 
to refer to it, A node in the flow-tree has a specified 
number of sons and each edge from the parent node to the 
son node is marked by an identification tag which is a 
sequence of 4 alphanumeric characters called its son 
number. The node number of any node in the flow-tree 
is the concatenation of son numbers which occur in the 
path from the root to the current node. Program constructor 
can now provide commands like delete, insert, replace or 
alter a node identified by its node number. In Fig, 3.1, 
we have given a sample Pascal-S program and in Fig. 3,2 
we have given its flow-tree representation. All the non- 
terminal nodes in this flow-tree axe marked by numbers for 
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use in Chapter 5. From this tree it should be apparent 
how the scheme works, 

3.2 FORMAT AND STORAGE OF SSPF 

The nodes in an SSPF may be of various types depending 
on the programming language. In our programming system 
we have used a total of 20 possible node types. These 
have been listed in Appendix A (see Fig, 3,3 also), 

A node in an SSPF always contains basic information 
related to the nodej other types of information may or may 
not be present. Appendix A lists for each node type its 
compilation related information also. 

The nodes in a flow tree are mapped on to a set of 
records in a random-access file. These records are numbered 
1 through n, where n is the size of the file. These numbers 
can be used to access the corresponding records. There are 
totally 16 possible record types to accommodate various 
kinds of information in the SSPF, Complete description of 
each can be found in the definition of types information 
(in INCOMP) and cell (in PASED), in the program listings and 
is also shown in Fig. 3,3, 

Each node is associated with a single noderec record 
and a set of linkrec and sonrec record pairs, linkrec record 
contains pointers to the sons of a node and sonrec record 


contains corresponding son numbers. Each of these two records 
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can accommodate at most 3 sons. Since a node in a flow- 
tree can have arbitrary number of sons, depending on its 
type (exs catnd ) to accommodate extra sons, a list of 
these pairs are used, linked through the field next in 
linkrec, 

A noderec record has the following fields in the 
specified order. Nodekind , nodenumber , pparent , compinf 
and The field nodekind indicates the node type, 

Nodenumber holds a number specifying its position in the 
random access file. The field pparent provides a pointer 
to its parent node where as compinf points to a list of 
records representing its compilation - information. 

The field _st represents the status of the node. It 
can have three values; new , old or errors. If the value 
of ^ is new then the node is said to be a new node. Such 
a node does not contain any compilation-information. If 
the value of _st is old then it is said to be an old node 
and is associated with compilation- information. If st is 
errors then the node may contain some errors. It also 
does not contain any compilation- information. 

Certain nodes represent source text, (only terminal 
nodes). This is stored in a sequence of sourcerec records 
linked by the field next. Each sourcerec record contains 
about sbufflnq (= 19 in our programs) characters. The 
length of sbufflnq is to be decided in consideration with 
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the size of the other records. The last sourcerec record 
contains the character '?' (eos) to signify end of source. 
The description of other nodes is discussed in other 
chapters. 

Fig. 3.4 shows the SSPF created for the program in 
Fig, 3.1, showing how various records are linked. 


CHAPTER 4 


PROGRAM CONSTRUCTOR 

A program constructor is a key component in any 
programming system based on structure of source programs. 

Its basic feature is that it is aware of the structure of 
the source programs and allows the programmer to view them 
as structured objects. 

In, this chapter, we have given an overview of the 
functions of a program constructor and described the 
implementation of PASED, a program constructor, we have 
implemented for the programming language Pascal-S. Our 
program is based on a syntax oriented editor for Pascal-S, 
described in [PAR 8l] and is essentially the same, with 
the required modifications. In this chapter, we have used 
the terms 'Program Constructor’ and 'editor’ inter- 
changeably, 

4.1 OVERVIEW OF A PROGRATJl CONSTRUCTOR 

A program constructor is basically an editor but 
differs from the existing editors by providing its users with 
an environment that permits a structured view of programs. 

We can formulate several functions it is required to do. 

4.1.1 Program Creation 

Accepting programs from the user and creating the 
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corresponding flow trees and preserving them in syntacti- . 
cally correct form is the program entry function. This 
involves accepting the source text and performing the 
necessary steps to map it into a flow- tree form (this may 
involve parsing) and ensuring the absence of block 
structure errors (without which formation of flow tree is 
impossible). Some form of syntax prompting can be provided 
to aid the user. 

4.1.2 Program Traversal 

Before performing editing one needs the capability 
to selectively display and traverse parts of the program. 

The program constructor must allow the user to position 
himself at various points in the program and delineate 
a certain portion around that point. Since we are storing 
our programs as a tree, this consists of being able to 
identify a node in the flow tree and to refer to the 
subtree rooted at this node. We can provide position 
dependent traversal in which user can refer to the parent 
or son of the current node and position independent traversal 
in which user can refer to any arbitrary node in the flow 
tree. 

4.1.3 Program Editing 

Deleting program segments is the easiest task the 
editor can be asked to do. This involves clipping sub- trees 
representing the offending portions. Thus entire procedures, 
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statements, declarations, etc., can be deleted. However, 
some parts like the condition part of a while - ^ statement 
cannot be deleted. The editor has to guard against opera- 
tions which may introduce such errors. 

Insertion of a new section is very essential. This 
involves constrcting a flow-tree segment for this section 
and attaching the root of this newly created segment as a 
son to the appropriate node. 

The delete-insert operations can be combined to give a 
Replace operation which can replace individual nodes of any 
kind or whole flow tree segments. 

Apart from these basic operations, the editor can be 
equipped to transfer, copy and alter various nodes or flow 
tree portions. It can also have operations that search 
for a node containing a given string or substitute a string 
for another string in a flow tree segment. 

4.2 PROGRAM DOCUMENTATION OF PASED 

The format of the SSPF for Pascal-S programs is outlined 
in Chapter 3. This format is essentially reflected in the 
definition of the record type cell in the PASED program (see 
Fig, 3,3) . 

Nodetypes and Rr>r typ es represent the types of nodes and 
records present in the SSPF respectively, PASED makes use 
of only 4 kinds of records i Headrec . Nodrec , Linkrec , and 
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Sonrec* The rest of the records are used in the incremental 
compiler INCOMP (Chapter 5), 

Some variables of importance are given below : 

Stat is a variable that fetches a statement type from 
the user. Kevtab is an array of key word strings used in 
changing the key words into lower-case strings. Err is a 
variable that is set to an appropriate value, whenever, an 
error occurs and is subsequently used in errout procedure 
to display an error message. Pat and patl are two string 
buffers used in Found and Substitute procedures. Bufl is a 
buffer for holding source text of a particular node, used 
alter it . alter , and substitute procedures. 

Following are some variables local to the procedure 
edit ; Curiine is an array of records, each record having 
a son number and an address of the node. It stores the 
current node pointer. It is used as a stack with curlev as 
a stack pointer. 

Newproq is initialized to true, when entering a 
program for the first time and is used to skip changes tatus, 

4.2.1 Random Access File Routines 

The programs are written in Pascal. Pascal on 
DEC-10 does not support random l/O (input/output). But our 
programming system requires such random access. Hence, a 
random access file package has been implemented in MACRO-10 
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[PAR 81], It has three procedures, 

procedure select ( var .Fs filetype); 

procedure getrecord ( var F:filetypej i; integer )? 

procedure putrecord ( var Fs filetypej is integer )? 

which have to be declared as external procedures in any 
program using them. 

Select initializes a file for random access l/O and 
getrecord and putrecord read and write respectively at the 
specified record position, 

4.2,2 Procedures for Program Entry 

Procedures getnode and putnode get and put a record 
respectively in the file tmp using the external random- 
access file routines. The procedures Readbig and Readsmall 
are external procedures for reading a character from tty . 

They both return a CR LF combination, only as LF , 
Readsmall reads characters as it is and Readbig converts 
them to upper case before reading. Re ad tty reads a character 
from tty using these procedures and the value of guote * 

Inchrw , echo and noecho are also external procedures, 
Inchrw also reads characters from tty and makes them 
available as soon as they are typed, without pressing 
RETURN • Noecho suppresses echoing of characters typed 
and echo enables this. They are used in alter. 
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The main program gets a filename using qetf ilnam . If 
the file is not already there on the disk then it enters 
the program entry mode by calling proc with level = O, 

Proc and func are procedures to enter a procedure and 
a function respectively. As a program is a special case of 
a procedure, it enters a program if level = 0, The variable 
level denotes nesting a depth of the current program 
segment in the flow- tree and is used for indentation and 
printing of node numbers. They have arguments nodenum , 
Inodenum and snodenum which represent node numbers where 
the flow-tree segment for the procedure/function to be 
entered is stored. They are used for filling the pointer 
information, 

Proc enters the name and parameters of a procedure and 
then calls block to enter constant declaration, type decla~ 

ration and var declaration by calling the appropriate 

• « 

procedures (suggested by their names) and then calls proc/ 
func to enter inner procedures or functions. 

Finally block calls csst to enter a compound statement. 
Procedure statement enters a statement. It uses qettvpe 
to get a statement type and calls the appropriate procedure. 
The procedures to enter various statements should be readily 
apparent if gone through, as they are written, strictly 
according to Pascal-S syntax. 
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All declarations, variables and expressions are accepted 
the request of the accepting routines through 
procedure readexpr . It reads a string from tty converts 
identifiers to upper case, key words to lower case and 
leaves literais alone. It generally uses RETURN as an 
end of source string unless when entering a Record in which 
case, it uses it to indent fields and keeps accepting 
strings until end is encountered. 

4,2,3 Procedures for Program Modification 

Edit is the main procedure containing all the procedures 
needed for editing an SSPF, The main program calls edit 
when a. file that already exists is given a after entering a 
new program. 

The statement part of edit consists of a loop which 
gets a command (getcomand ) and does it (docomand) if there 
are no errors. If any error occurs, during any of the editing 
procedures, variable err is accordingly initialized and an 
appropriate messages will be displayed. 

The significance of procedure chanqestatus is discussed 
in Chapter 5* This procedure is not required for any new 
program, 

Getcomand gets a. command from the tty in com and any 
arguments like nodenumber, sonnumber, registernumber etc, 
depending on the command, Getentry gets a sonnumber from tty 
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and concatenates it with the parent nodenumber to get the 
nodenumber of the son in qotoline. Getlineno gets a new 
node number. 

Procedure delete identifies the son to be deleted 
of the current node and deletes simply the pointer in the 
parent node to that node, if the syntax permits it. 

Procedure insert inserts a pointer at an appropriate 
place to the new flow- tree segment created for the inserted 
section. 

These two procedures use savelink and Restorelinlc . 
Savelink saves all the pointers of a node to its sons, 
which occur to the right of the given son. Res to relink 
restores these to the node. They are used to shift the 
pointers in case of a delete or an insert operation. 

Procedure Found searches the source nodes in the given 
sub- tree for an occurrence of the pattern in variable pat. 
and displays that node along with its node number. It uses 
function pmatch for this, pmatch is a pattern matching 
routine that is based on the Knuth-Morris-Pratt linear 
algorithm . Its value is true if a pattern match occurs and 
pos will be the position in the source marking the beginning 
of the pattern? otherwise it is false. 

Similarly, substitute replaces all the occurrences of 
the string in pat by the string in patl in the given sub- tree. 



23 


It also uses pmatch for pattern matching. 

Alterit is the procedure that alters a given node,. 

It it is a source node, it is copied into a buffer, bufl 
al'ter is called. Alter permits modification of bufl 
and it is copied back into the original source node at the 
end. If the root of a sub- tree is given to alterit , it -> 
alters all the source nodes in that sub- tree, 

Displaversnodes displays the list of nodenumbers 
which represent erroneous nodes. It takes an argument, 
a pointer to the 1st record in a list of linkrec records 
and follows each link of this record which again points to 
a list of sonrec records to display the nodenumbers. 

Updateerrors , checks this list of nodenurabers after 
the end of each command that results in the modification of 
SSPF and if currently modified node number occurs in this 
list, it is deleted. 

The procedures which transfer and copy nodes are very 
straight forward as they use delete and insert operations 
as primitives, 

Savwhat displays the nodenumber of the current node and 
all its son numbers if there are any. 

Display takes as argument, a nodenumber level and 
depth and displays the sub-tree rooted at this node on the 
tty as a user readable text to the specified depth. It uses a 
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Compress is the procedure which deletes all the 
garbage accumulated during editing and compacts the file. 

It starts with root node and traverses the program tree 
with all the compilation information and copies it into 
file tmp2 and in the process discards all those records 
which do not occur in the program tree. After compaction, 
file tmp2 is copied back into main. 

Our description of program PASED has been very 
sketchy and more detailed information can be obtained by 
going through the program listing, 

A list of the procedures, which occurs in the program 
PASED, showing their static nesting is given in Appendix B, 



CHAPTER 5 


INCREMENTAL COMPILER 

Structured Source Program Files created by the Program 
Constructor are amenable to incremental compilation. That 
is, after a program is modified only the modified part need 
be recompiled. This is a desirable feature particularly for 
programs under development. 

In this chapter, we have described briefly the design/ 
implementation of an incremental compiler which works on the 
SSPF created by the program constructor PASED* We have 
started with a version of the compiler described in [JAJ 80]. 
This compiler has been implemented, just to prove that 
incremental compilations of programs in a block structured 
language is possible. It works on a sequential file on to 
which the Pascal-S flow tree is mapped. Since Pascal on 
DEC- 10, the language in which this compiler was originally 
written, allows only sequential files, the nodes in the 
flow tree are arranged in the file in a specific order known 
to the compiler. On such a file, the editing environment 
we have discussed in Chapter 1 cannot be implemented. Hence, 
we have implemented another version, which can now work 
directly on the SSPF created by the program 

To properly understand the design of a compiler it is 
necessary to know both the features of the source language 
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to be compiled and the architecture of the underlying 
machine on which the generated code is to be executed, 

A description of the main features of Pascal~S, the 
source language can be found in Chapter 6, The compiler 
produces intermediate code and if compilation is successful, 
it interprets the code generated. Section 5,1 is a descrip- 
tion of the machine on which the object code is interpreted. 
Section 5,2 presents an overall view of the compiler. The 
symbol table and other tables used in the compiler are dis- 
cussed in Section 5.3, The crux of this chapter is on how 
incremental compilation is achieved and can be found in 
Section 5,4. Section 5.5 describes the set of nodes to be 
recompiled after a program is modified. The implementation 
aspects are discussed in Section 5,6 and Section 5,7, 

Concludes this chapter by outlining the method used for 
debugging the programs. Sections on Pascal-S machine and 
symbol tables and other tables have been taken from [JAJ 80], 
and are given here for the sake completeness. These descrop- 
tions can also be found in [WIR 75] also. 

5.1 Pi\SCAL-S MACHINE (INTERPRETER) 

The compiler produces code for a hypothetical stack 
machine (which we call Pascal-S Machine), This machine is 
itself defined as an algorithm the interpreter of the compiled 
code. We have used the same interpreter as the one used in 
[WIR 75], This is encompassed in procedure interpret in the 
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program. For the sake of completeness we have discussed 
briefly its organization. 

The interpreter has a small store S, organized as a 
stack. Two index registers T and B control the stack, A 
program counter PC, an instruction register a program 
status register, ^ and a display to speed up access to 
non-local variables, are -also there. Each element in the 
stack is either an integer, a real number, a boolean value 
of a character. The main interface between the compiler and 
the interpreter is the array code which holds instructions 
generated by the compiler. The primary structure of the 
interpreter is : 

procedure interpret! 

begin initialize all the registers and auxiliary 
counters; 

repeat 

irs= code [PC]j PCs= PC+lj 
interpret ir 
until PS ^ Runj 

if PS 4 ^ fin then postmortem dump 

end ; 

Each instruction has 3 fields s f, x and y. f is an 
operation code (opcode) and can take a value between 0 and 
63. Opcodes 0,1,2 generate an address of the data element, 
with offset y in the currently active data segment on level x 
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and loads it on top of the stack. Opcode 3 updates display 
by using fields x and y, opcode between 8 and 30 need only 
field y. Opcodes 31 to 63 need neither of the fields x and y. 
Their arguments are assumed to be available on the top of 
the stack. 

5,1.1 Procedure Calls and Storage Layout 

On a procedure call, a stack section (activation 
record) is reserved for the called procedure on the top of 
the stack. The beginning of this stack section is a special 
mark called sectionmark. The sectionmark contains a pointer 
called the dynamiclink to the beginning of the stack section 
corresponding to the calling procedure. The chain of dynamic 
links traces out the dynamic history of the program execution. 

The sectionmark also contains a staticlink which is a 
pointer to the stack section corresponding to the procedure 
in which the currently active procedure is declared. The 
chain of static links specifies the static nesting of the 
procedures and is necessary in determining all the accessible 
data names for the currently active procedure. This chain 
is also copied in display to speed up the accessing. 

Apart from these two, a sectionmark also contains the 
returnaddress , a pointer to the symbol table and a location 
to store the result value (used only for functions). 

All the parameters of a procedure are processed and 
storage is allocated for them on the top of the stack, 
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immediately above the section mark. The storage for local 
variables is allocated after this. In case of value 
parameters, only their values are loaded and for variable 
parameters their addresses are loaded. All the variables 
are initialized automatically. Finally, instruction registers 
B and T are updated properly and rc is set to point to the 
first instruction of the activated procedure. 

Upon exit from a procedure a return instruction is 
executed, which reverses the operations performed by a call 
instruction. If the static level of the current procedure is 
lower than that of the procedure to which control returns, 
display is properly updated. 

Opcodes 3,18,19,32 and 33 perform these operations. 

5.2 OVERVIEW OF THE INCREIVENTAL COMPILER 

The SSPF created by the program constructor forms the 
input to the incremental compiler which produces the object 
code for the interpreter, A large part of the compilation 
information (such as symbol table entries) generated during 
compilation, which is used subsequently to derive the object 
code is preserved in the SSPF in a suitable form, so that it 
can be reused in subsequent compilations. The central idea 
is to associate a packet of compilation information to each 
node in the SSPF. This incremented SSPF is available for 
modification to the editor to reflect the changes desired by 
the programmer. Recompilation of the modified SSPF then 
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requires deriving information only for those nodes, which 
and linking it together v./ith information associated 
with other nodes. 

The compiler expects its input in a (logical) file 
called iproqf . It is associated with a physical file at 
runtime. The file is then copied into a temporary file 
called tmp (this is necessary in view of the random access 
file package used), and works on this temporary file. After 
compilation is over, the incremented temporary file is 
copied back into iproqf . 

The tasks performed by the incremental compiler can be 
broadly divided into : 

1, to get and test records in file tmp 

2, to scan the source records associated with a new node 

3, to copy compilation information already available in tmp 

4, to construct records for newly generated compilation 
information and to append these to the corresponding 
nodes for use in subsequent compilation 

5, to handle symbol table and other tables 

6, to analyze individual nodetypes. 

The compiler contains a collection of procedures and 
is discussed further in Section 5.6, 

For proper understanding of the compiler, we can divide 


it into 2 parts s 
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1. The part processing declaration nodes t nodes of type 
proq ^ proc , rune , const , type , var , consdecl . tvdecl and 
yarded 

2. The part processing statements and expressions ; nodes 
of the type cat , if, v;d, ru, fori , for2 , case , onecase , 
and a ssign. 

Their common interface is symbol table tab and its 
associated tables. These tables are constructed, while 
processing declaration nodes and are then used to derive the 
context in which other nodes are compiled. Knowledge of 
these tables is therefore very essential, 

5.3 COMPILER TABLES AND THEIR STRUCTURE 

The key table is tab . The index variable for this 
table is t, and always points to the last entry made in tab . 
Each declared identifier results in one entry. All identifiers 
belonging to the same procedure (block) are linked together 
using the field link. The link field of the first identifier 
declared is set to 0} The entry with index 0 is used as a 
sentinel for searches on tab. 

The field obi specifies whether the declared identifier 
is a constant, a variable, a type, a procedure or a function. 
The type of the identifier is indicated by the field called 
tvp . The meaning of the remaining fields is dependent on 
the contents of these two fields. 
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If the object denoted by the identifier is a procedure/ 
function or a type of records then, the ref field is an 
index to the block table btab* If the identifier is of type 
arrays then ref is an index to the table of arrays, atab « 

In all other cases it is 0. 

The field normal is meaningful only for identifiers, 
which denote variables. It specifies whether an identifier 
is an actual variable or a value parameter to be addressed 
directly or a variable parameter to be addressed indirectly. 

The procedure block uses the variable ^ to allocate 
storage on the stack section. The value of this variable 
is used to set the adr field of identifiers that are 
variables. The field lev records the level at which the 
identifier is declared. The pair lev , adr thus forms 
an address for any variable. If any entry is a procedure 
or a function the adr field points to the first instruction 
in this procedure or function. If the entry is a type 
identifier then the value of adr field specifies the size of 
the variables of this type. If the entry is a constant, 
then if it denotes a real constant, adr is a pointer to a 
table of real constants called rconst . For any other type of 
constant, adr field directly specifies the value of the 
constant. 

T'he table atab stores the information regarding every 
declared array. The fields inxtyp . low and high specify 
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indextype, and indexbounds. The fields eltvp and elsize 
indicate element type and element size. The field elref 
is used as the field ref in tab. Although, elsize can be 
obtained from eltyp and elref , it is stored for convenience. 
The total store needed for the array is given by size . 

Each procedure, each record definition causes an entry 
in the block table btab . The fields lastpar and psize are 
used only for procedures. They specify the last parameter 
of the procedure (by the use of index to tab ) and the total 
store needed for the parameters. The field last indicates 
the last identifier declared in that procedure. The value 
of the field last is updated as each new entry is made. The 
field vsize specifies the total store needed for the varia- 
bles declared in that procedure. 

In addition to the fields described above the 3 tables 
tab , atab and btab have a special field called token. This 
field is added for providing a unique identification of 
individual entries of the tables. Their use is further 
explained in later sections. 

For the above table, the entries created during the 
compilation of a procedure can be disposed off when the 
compilation of that procedure is over. However, they are 
retained as they are needed in performing postmortem dump, 
in case of any run time errors. This makes it unnecessary 
to copy certain information into the code, for example, data 
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segment length and array index bounds*, an instruction 
requiring such information contains an index of the 
relevant entry. 

Moreover, due to the chosen nature of the interpreter, 
the compiler has to create and maintain two more tables 

J^cdnst and stab , for their use in the interpreter. The-, 
table rconst contains all the real constants used in the 
program. Since the instruction format does not permit 
passing a real constant, in the code, the index of the 
relevant entry is used in its place. 

The table stab contains strings that are used as 
parameters of procedure write. In the code generated, for 
a call to this procedure, a reference may be made to this 
table to indicate the desired string. 

We have given an example, in Fig, 5,1, showing the 
tables tab , atab and btab and code generated for the 
example program in Fig, 3,1. 

5.4 INCREMENTAL COMPILATION 

Compilation of an SSPF involves compiling of every 
node in it. The compilation of a node produces a) the 
object code corresponding to this node and/or b) the 
information necessary to update the global compiler tables. 

Any such information is referred to as compilation-information. 
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The principle of incremental compilation consists of 
preserving as far as possible the compilation information 
produced in one compilation of a program, so that it can be 
used in subsequent compilation, by avoiding duplication of 
effort. This may be done by storing with each node, the 
compilation information it produces. If the source con- 
tained in this code, remains unaltered, then in a subse- 
quent compilation, it need not be compiled. In such case, 
the preserved compilation-information is simply copied. 

There are however, cases when recompilation of a 
node becomes necessary due to changes in other nodes (or 
addition of a new node), even though the source code in 
that node is not altered. To cater to these cases, we can 
derive rules, to identify all such nodes and this, we 
discuss in the following section. 

Compilation-information usually contains a reference 
to the compiler tables. Such a reference is usually 
specified in terms of the corresponding index of' the 
referred entry. However, physical position of an entry 
in the table may vary from compilation to compilation. 
Hence, we associate with each entry a unique identity 
token (which is simply an integer) that remains invariant 
from one compilation to another and we use this instead 
of the corresponding table index. When we are copying 
• the compilation- informat ion, we can convert these tokens 
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to table indices by searching the token values in the 
appropriate table. 

In our implementation, identity tokens are created 
for entries in table, tab , atab and btab . Entries in 
rconst and stab are copied whenever there are references 
to them. Since entries in stab are referred from only 
one place there is no duplication, which may not be true 
for entries of rconst. 

5.4.1 Compilation Information of Different Node Types 

Appendix A gives the compilation-information which is 
stored with nodes of various types. This information is 
stored as a list of records, with a pointer to this list 
in the corresponding noderec record in the field compinf . 

The possible types of records used for this purpose are 

tabrec, atabrec, btabrec, btalbrec rconstrec , stabrec, 

' ' " ■ . " ' ————— , ' " ' 

coderec, flaarec , exprtvprec , cltvprec and tokenrec. 

Nodes of type cat , if, ru, fori , for2 , case , onecase « 

cind assign do not produce any contextual information. We may 
consider only, what they contribute to object code. 

Catnd contributes no instructions to the object code. 

So no compilation-information need be associated with this. 
Though, if, wd , ru , fori , for2 and onecase contribute only 
jump instructions, they contain compilation information 
generated from their terminal sons (source nodes). For 
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example, _if, v^, ru nodes have a boolean expression as a son, 
fori an d for2 nodes have a variable and tv;o expressions as 
sons and so on, Onecase node contributes apart from jump 
instructions, only those instructions, which can be derived 
from the compilation-information, stored, with the associated 
clabel nodes. 

Case node contains compilation- information about the 
case expression. Expressions may use real constants and 
hence may contribute instructions which make references to 
rconst table. Because of the vjay in which the rconst table 
is constructed (to avoid duplicate entries), it is possible 
that some of the entries that are referenced may have been 
caused due to some other nodes* If any of these nodes gets 
recompiled due to some reason, then the entry referenced 
may not exist during next compilation. To overcome this, we 
directly store the real constants referenced by the contri- 
buted instructions in rcons tree records, 

m 

Assign nodes and expression nodes may also make 
references to tab and atab tables. Therefore, before storing 
these instructions, the references have to be converted to 
corresponding identity tokens. 

Since a procedure call node (PC) may be a call to the 
procedure write , it m^y require a part of the stab table, 
to be copied in the compilation-informations. It is for 
•this purpose.' stabrec records are used. Each stabrec can 
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accommodate upto 18 characters. If the string length is 
more than 18 then a sequence of stabrec records is used 
linked by the field following. 

Some nodes require the type of their expressions sons 
to be included in the compilation-information. This is 
used to check type compatibility. So exprtyprec records 
are used for this* 

For case label nodes, we need only store the list of 
constants and their type. 

The flags which indicate whether input , output are 
declared in the program heading or not have to be stored 
in the compilation information for prog node. So fl agree 
record is used for this purpose. Along with these flags, 
the program name, which is used in the compiler to produce 
a listing of compiler tables in the file output , is also 
stored. 

The nodes to be discussed below require storing entries 
tab, a tab , btab tables. The link and ref fields (when 
the latter is not 0) of the table tab and the field el ref 
of the table atab contain indices. While storing ref and 
elref these are converted to corresponding tokens. It is 
better to regenerate link whenever required than to use 
tokens . Since the fields last and lastpar are dynamically 
updated, they need not be stored. 
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Each proc/func node causes an entry in the table tab. 

The adr field of this entry points to the first instruction 
of this procedure/ function and is to be derived anew for 
each compilation, 

Proc/ func nodes also contain certain tab records for 
their parameters. Also, the value of the variable ^ which 
indicates the size of the store needed to load the parameters 
is also preserved in btablrec record. 

Const , type . and var nodes do not generate any compilation-i 
information. 

Consdecl node contains tab and/or rconst entries. 

However, the ref field in tab need not be converted to 
identity tokens, as its value will be zero for constants, 

Tvdecl and vardecl nodes can cause entries in tables 
tab , btab and atab and hence these are included in these nodes 
in corresponding records. In btab entries, only psize and 
token fields need to be preserved. For a vardecl node, we also 
store dx « 

Fig. 5. 2 shows the incremented version of the SSPF in 
Fig. 3.4 and shows how the compilation-information is stored. 

5,5 SCOPE OF FiE COMPILATION NECESSITATED BY CHANGES 

If an already compiled program (SSPF) is modified by the 
program constructor, obviously those nodes, whose source has 
been modified must be recompiled. Hence, their status has to 
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be made new. But depending on the type of the node modi- 
fied, other nodes may also be required to be recompiled. 

For various node types, the set of nodes to be recom- 
piled is given in Table 5,1. This table is for the case 
when the node in question is replaced or altered. 

Suppose a node has. been inserted into the SSPF, This 
can be treated as equivalent to the above case. We can think 
that this node is already present in the SSPF, with null 
source, to which source has been added. Similarly, deleting 
a node can be taken care of. 

The program constructor provides many more operations 
like transferring which is equivalent to deleting a node 
from one place and inserting at some other place, copying 
which is equivalent to inserting a node and substituting 
which is equivalent to replacing/altering an already existing 
node. 

5.6 IMPLEMENTATION NOTES 

The incremental compiler INCOMP works on the SSPF pro- 
duced by the PASED (program constructor). The organization 
of SSPF has already been explained. 

As has been pointed put, each node (identified by a 
noderec record) can have as its sons either source code 
(terminal nodes) or nodes of other types (non-terminal nodes). 
Each squrce node occurs, as a list of sourcerec records linked 
by next. 
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The procedure qetfilnam gets a filename and switches 
if any from the tty * A modified reset command is used to 
associate this filename with the variable iproqf « The 
switches are used to initialize optionl and option2 . The 
compiler copies iproqf into a temporary file tmp and works on 
this. After compilation is over, it is copied back into 
iproqf which then represents the incremented versions of the 
original file. 

The file output produced by the compiler contains all 
the node numbers whose status is new and hence compiled, 
along with their source code and error messages if any. 
Switches are available to suppress this listing ( option2 ) . 
Output also contains the results of execution. 

In the present implementation, each entry of the 
tables tab , atab and btab is associated with a unique token 
which remains invariant from one compilation to another. 

These are simply integers starting with one. To make sure 
that the generated tokens are indeed unique it is necessary 
to keep track of the tokens used in previous compilation. 

So the last token used is to be preserved. This is done using 
tokenrec record. The Headrec record which is the first re- 
cord in the file contains a pointer to tokenrec record in 
the field tokrecno. 

Procedures qetnode/putnode in the INCOMP programs get/put 
a. record given a location in file tmp . They make use of the 
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The first record in the file is always headrec record. 

It contains the number of records in the file and is used 
to initialize nextnode , which always points to the last record 
in the file. Using tokrecno , tokenrec record is read and 
lasttokenl is initialized. After ai-l the initializations, 
the main program calls prognode. 

The variable curline is an array of records each record 
containing two fields lineno and nodeaddr . It is used as a 
stack with curlev as a stack pointer. The pair, curlev , 
curline identifies at any time the node number and 
address of the node being compiled. Setline is used to 
update curline before compiling a new node. 

The compilation proceeds by compiling each node in 
the SSPF. For each node type, there is a procedure to 
compile nodes of that type. The names of the procedures 
fairly suggest, which type of nodes they are compiling. 

In general, each procedure does the following : 

The status of the node is first checked. If its 
value is new then the node to be compiled is new and it 
has no compilation-information. Therefore, all its source 
sons are to be scanned. 

The scanning of a source son proceeds as follows ; 

Each source son is a list of sourcerec records. The variable 
currecno is initialized so that it points to the first record 
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in this list. Then initnextch is called to provide the 
necessary initializations. After this procedure insymbol 
is called repeatedly until the entire source is scanned. 

This is signified by encounting an eos = ’?' symbol. 

Procedure insymbol uses nextch to supply the next 
character in the source, via ch. Whenever, CC = esbufflnq , 
Nextch . fills the variable line with following sourcerec 
record if any and sets CC to 0. It also writes the source 
in the output file if option2 is true. 

After scanning all the source sons, the compilation 
information generated is stored in the node itself as a 
list of records, with a pointer to the first record in this 
list in the field compinf ♦ for use in subsequent compilations. 
This information is different as discussed for each node 
(see Appendix A)^ 

If the status of the node is old then it has compilation- 
information associated with it and is copied by accessing 
this through compinf . After this, the source sons are 
skipped. 

The non-terminal sons are again compiled by calling 
appropriate procedure. 

The procedure describing the compilation of each node 
is straightrforward and can be easily understood. 

However, the points to be noted are that for compiling 
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expressions, the syntex of Pascal-S expressions is straight- 
away used. This results in a set of mutually recursive 
procedures. 

For copying compilation-information, and generating 
records for storing this, the procedures used are described 
below. 

Outtabrec . outatabrec . outbtabrec create records 
corresponding to entries in tab , atab and btab tables for 
storing compilation-information. Any references to other 
tables are converted into identity tokens. 

Outcoderecs is used for storing object code generated 
for a particular node. Any reference to tab , atab . entries 
are stored as corresponding tokens. Any real constants a 
or strings used by these instructions are stored in tables 
temprconst and tempstab temporarily and are used in generating 
r cons tree and stabrec records in procedures outrconstrecs 
and outstabrecs . 

Copvtabrec , copyatabrec and copvbtabrec are used 
for copying tab , atab and btab table entries. Any references 
to other tables are resolved using setelref and setlinkref, . 

Incoderecs , inrconstrecs and instabrecs are used for 
copying object code, real constants and string into code . 
rconst and stab respectively. The instructions copied may 
some time contains references to rcons t and stab tables. The 
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procedures filclnrconst and filcinstab prepare a list of 
such instructions and are used in inrconstrecs and 
instabrecs respectively. 

In compiling source nodes, errors can occur. Whenever, 
an error occurs, the procedure error is called to produce an 
error message in the output file* This property of error is 
made use of in preparing a list of nodes whose compilation 
resulted in errors and marking their status as errors * This 
is accomplished as follows s 

The variable again is used only in setline and error* 
Before starting scanning of a source son, setline is called 
which initializes again to false. In scanning, if an error 
is encountered, error is called, which sets again to true 
and marks the parent node status as errors and stores the 
node number of the son in the list of error nodes. Any 
subsequent errors do not cause the same node to be marked 
again, as the value of again would already have been made 
true. 

Each node number is stored in a list of sonrec records, 
with a pointer to the first record in this list, stored in 
® linkrec record. This linkrec record is again a part of 
another list of linkrec records, a pointer to which is 
stored in the headrec record in the field errnum. The editor 
can display these node-numbers by following the list of 
linkrec records to direct the programmer to correct them. 
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The set of nodes to be recompiled is computed and 
the status of all these nodes is made new after discarding 
the associated compilation-information. This is accomplished 
by procedure chanqestatus in the program constructor. 

Changes tatus is called after completing each editing 
command. It is executed only if the command recently 
performed is one of those, which may result in the modifi- 
cation of the SSPF, It directly implements the rules given 
in Table 5.1, by a set of recursive procedures. 

The program listing can be referred to for more detailed 
information, 

A list of the procedures which occur in the program 
INCOMP showing their static nesting is given in Appendix C, 

5.7 DEBUGGING OF THE PROGRAMS 

Program testing and debugging are very crucial in any 
software project. If they are not carried out properly they 
can consume inordinate amount of time and can also result 
in the loss of confidence of the implementor as well as 
the user. 

We have proceeded to test and debugg our programs in 
a step wise manner. During implementation and subsequent 
modifications, we have made use of various kinds of test 
outputs. 
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In testing the program constructor, we have taken 
dumps of the SSPFs created for various programs and checked 
to seo if their structure is satisfactory (even after editing). 

In testing the incremental compiler, we have obtained a 
dump of various compiler tables and code generated for 
different programs and compared them with those obtained 
from the original version. 

During final stages, we have run a number of meaningful 
Pascal-S programs using the system and made sure that the 
results of execution are satisfactory. For each program, 
we have made various kinds of edits and compiled/executed 
them subsequently, thus achieving a reasonable level of 
confidence. 
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. CHAPTER 7 
OONGLUDING REMARKS 

We have Implemented a programnlng envlxonnent that le 
aware of the structure of the source programs* As Impor- ■ 
tance of suOh gn envlronnent need not be overaiqphaeized* 

We have started with an existing syntax oriented editor 
for Pascal-S and an Incxemental compiler for l^e same pro- 
gramming language and modified these two to work on a coomon. 
Interface,, thus deriving a powerful programming tool. 

Present System can be used as an instructional tool 
. for Students taking a first course In programming* Audi a . . 
systMi provldss a healthy and unlfoxm-pfogrammlng environment 
for the students and also makes It unnecessary for them to 
know the syntactic details of the programming language 
thoroughly* 

We feel that such a progranalng system can be mire 
useful If extended to the full set, progr.tfnBing language* 

The nature of the compiler ws have Irqplsmented Is such that 
the object code produced makes a number of references to 
the compiler tables* Much work can be saved if object 
code is made independent of the compiler tables* 

There Is scope for improving the program constructor* 
Error infoniatlon can be commuilcated to the user more 
effectively Instead of simply displaying a' list of nbde^ 
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nunbexs which have exmxe* Probably along with the node 
nunbexet displaying the exxoxe In the eouxce code may help 
the progxaamer* ^so the pnsent vexslon of tte pxogxam 
c one txiictor does no contest sensitive checks and the burden 
of the coii4>iler can be further reduced by incbipoxatlng such 
a feature in the pxogxam constructor Itself* 

. The Random Access file package makes It necessary for 
the file to. be. copied into a tenpoxary- file and after 
. ceopllatibn, again the tenpoxary file to be. copied back 
Into the original, file* By suitably altexii^ tills package* 
this duplication of flies can be avoided* thus saving a lot 
of CPU ilme as well as response time* 
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